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                                 (DOTS)

Abstract

   This document discusses multihoming considerations for DDoS Open
   Threat Signaling (DOTS).  The goal is to provide some guidance for
   DOTS clients and client-domain DOTS gateways when multihomed.
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1.  Introduction

   In many deployments, it may not be possible for a network to
   determine the cause of a DDoS attack [RFC4732].  Rather, the network
   may just realize that some resources appear to be under attack.  To
   help with such situations, the IETF has specified the DDoS Open
   Threat Signaling (DOTS) architecture [RFC8811], where a DOTS client
   can inform an upstream DOTS server that its network is under a
   potential attack and that appropriate mitigation actions are
   required.  The DOTS protocols can be used to coordinate real-time
   mitigation efforts that can evolve as the attacks mutate, thereby
   reducing the impact of an attack and leading to more-efficient
   responsive actions.  [RFC8903] identifies a set of scenarios for
   DOTS; most of these scenarios involve a Customer Premises Equipment
   (CPE).

   The high-level base DOTS architecture is illustrated in Figure 1
   (repeated from Section 2 of [RFC8811]):

                 +-----------+            +-------------+
                 | Mitigator | ~~~~~~~~~~ | DOTS Server |
                 +-----------+            +-------------+
                                                 |
                                                 |
                                                 |
                 +---------------+        +-------------+
                 | Attack Target | ~~~~~~ | DOTS Client |
                 +---------------+        +-------------+

                     Figure 1: Basic DOTS Architecture

   [RFC8811] specifies that the DOTS client may be provided with a list
   of DOTS servers; each of these servers is associated with one or more
   IP addresses.  These addresses may or may not be of the same address
   family.  The DOTS client establishes one or more DOTS sessions by
   connecting to the provided addresses for the DOTS server or servers
   [RFC8973].

   DOTS may be deployed within networks that are connected to one single
   upstream provider.  DOTS can also be enabled within networks that are
   multihomed.  The reader may refer to [RFC3582] for an overview of
   multihoming goals and motivations.  This document discusses DOTS
   multihoming considerations.  Specifically, the document aims to:

   1.  Complete the base DOTS architecture with multihoming specifics.
       Those specifics need to be taken into account because:

       *  Sending a DOTS mitigation request to an arbitrary DOTS server
          will not necessarily help in mitigating a DDoS attack.

       *  Randomly replicating all DOTS mitigation requests among all
          available DOTS servers is suboptimal.

       *  Sequentially contacting DOTS servers may increase the delay
          before a mitigation plan is enforced.

   2.  Identify DOTS deployment schemes in a multihoming context, where
       DOTS services can be offered by all or a subset of upstream
       providers.

   3.  Provide guidelines and recommendations for placing DOTS requests
       in multihomed networks, for example:

       *  Select the appropriate DOTS server(s).

       *  Identify cases where anycast is not recommended for DOTS.

   This document adopts the following methodology:

   *  Identify and extract viable deployment candidates from [RFC8903].

   *  Augment the description with multihoming technicalities, for
      example:

      -  One vs. multiple upstream network providers

      -  One vs. multiple interconnect routers

      -  Provider-Independent (PI) vs. Provider-Aggregatable (PA) IP
         addresses

   *  Describe the recommended behavior of DOTS clients and client-
      domain DOTS gateways for each case.

   Multihomed DOTS agents are assumed to make use of the protocols
   defined in [RFC9132] and [RFC8783].  This document does not require
   any specific extension to the base DOTS protocols for deploying DOTS
   in a multihomed context.

2.  Requirements Language

   The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT",
   "SHOULD", "SHOULD NOT", "RECOMMENDED", "NOT RECOMMENDED", "MAY", and
   "OPTIONAL" in this document are to be interpreted as described in
   BCP 14 [RFC2119] [RFC8174] when, and only when, they appear in all
   capitals, as shown here.

3.  Terminology

   This document makes use of the terms defined in [RFC8811], [RFC8612],
   and [RFC4116].  In particular:

   Provider-Aggregatable (PA) addresses:  globally unique addresses
      assigned by a transit provider to a customer.  The addresses are
      considered "aggregatable" because the set of routes corresponding
      to the PA addresses are usually covered by an aggregate route set
      corresponding to the address space operated by the transit
      provider, from which the assignment was made (Section 2 of
      [RFC4116]).

   Provider-Independent (PI) addresses:  globally unique addresses that
      are not assigned by a transit provider, but are provided by some
      other organization, usually a Regional Internet Registry (RIR)
      (Section 2 of [RFC4116]).

   IP indifferently refers to IPv4 or IPv6.

4.  Multihoming Scenarios

   This section describes some multihoming scenarios that are relevant
   to DOTS.  In the following subsections, only the connections of
   border routers are shown; internal network topologies are not
   elaborated.

   A multihomed network may enable DOTS for all or a subset of its
   upstream interconnection links.  In such a case, DOTS servers can be
   explicitly configured or dynamically discovered by a DOTS client
   using means such as those discussed in [RFC8973].  These DOTS servers
   can be owned by the upstream provider, managed by a third-party
   (e.g., mitigation service provider), or a combination thereof.

   If a DOTS server is explicitly configured, it is assumed that an
   interface is also provided to bind the DOTS service to an
   interconnection link.  If no interface is provided, the DOTS server
   can be reached via any active interface.

   This section distinguishes between residential CPEs and enterprise
   CPEs because PI addresses may be used for enterprises, which is not
   the current practice for residential CPEs.

   In the following subsections, all or a subset of interconnection
   links are associated with DOTS servers.

4.1.  Multihomed Residential: Single CPE

   The scenario shown in Figure 2 is characterized as follows:

   *  The home network is connected to the Internet using one single
      CPE.

   *  The CPE is connected to multiple provisioning domains (i.e., both
      fixed and mobile networks).  Provisioning Domain (PvD) is
      explained in [RFC7556].

      In a typical deployment scenario, these provisioning domains are
      owned by the same provider (Section 1 of [RFC8803]).  Such a
      deployment is meant to seamlessly use both fixed and cellular
      networks for bonding, faster handovers, or better resiliency
      purposes.

   *  Each of these provisioning domains assigns IP addresses or
      prefixes to the CPE and provides additional configuration
      information such as a list of DNS servers, DNS suffixes associated
      with the network, the default gateway address, and the DOTS
      server's name [RFC8973].  These addresses or prefixes are assumed
      to be Provider-Aggregatable (PA).

   *  Because of ingress filtering, packets forwarded by the CPE towards
      a given provisioning domain must be sent with a source IP address
      that was assigned by that domain [RFC8043].

                  +-------+            +-------+
                  |Fixed  |            |Mobile |
                  |Network|            |Network|
                  +---+---+            +---+---+
                      |                    |     Service Providers
          ............|....................|.......................
                      +---------++---------+     Home Network
                                ||
                             +--++-+
                             | CPE |
                             +-----+
                                   ... (Internal Network)

                Figure 2: Typical Multihomed Residential CPE

4.2.  Multihomed Enterprise: Single CPE, Multiple Upstream ISPs

   The scenario shown in Figure 3 is characterized as follows:

   *  The enterprise network is connected to the Internet using a single
      router.

   *  That router is connected to multiple provisioning domains managed
      by distinct administrative entities.

   Unlike the previous scenario, two sub-cases can be considered for an
   enterprise network with regard to assigned addresses:

   1.  PI addresses or prefixes: The enterprise is the owner of the IP
       addresses or prefixes; the same address or prefix is then used
       when establishing communications over any of the provisioning
       domains.

   2.  PA addresses or prefixes: Each of the provisioning domains
       assigns IP addresses or prefixes to the enterprise network.
       These addresses or prefixes are used when communicating over the
       provisioning domain that assigned them.

                  +------+              +------+
                  | ISP1 |              | ISP2 |
                  +---+--+              +--+---+
                      |                    |     Service Providers
          ............|....................|.......................
                      +---------++---------+     Enterprise Network
                                ||
                             +--++-+
                             | CPE |
                             +-----+
                                   ... (Internal Network)

      Figure 3: Multihomed Enterprise Network (Single CPE Connected to
                             Multiple Networks)

4.3.  Multihomed Enterprise: Multiple CPEs, Multiple Upstream ISPs

   This scenario is similar to the one described in Section 4.2; the
   main difference is that dedicated routers (CPE1 and CPE2) are used to
   connect to each provisioning domain.

                            +------+    +------+
                            | ISP1 |    | ISP2 |
                            +---+--+    +--+---+
                                |          |     Service Providers
          ......................|..........|.......................
                                |          |     Enterprise Network
                            +---+--+    +--+---+
                            | CPE1 |    | CPE2 |
                            +------+    +------+

                                  ... (Internal Network)

      Figure 4: Multihomed Enterprise Network (Multiple CPEs, Multiple
                                   ISPs)

4.4.  Multihomed Enterprise with the Same ISP

   This scenario is a variant of Sections 4.2 and 4.3 in which
   multihoming is supported by the same ISP (i.e., same provisioning
   domain).

5.  DOTS Multihoming Deployment Considerations

   Table 1 provides some sample, non-exhaustive deployment schemes to
   illustrate how DOTS agents may be deployed for each of the scenarios
   introduced in Section 4.

    +=========================+=======================+===============+
    |         Scenario        |      DOTS Client      | Client-Domain |
    |                         |                       |  DOTS Gateway |
    +=========================+=======================+===============+
    |     Residential CPE     |          CPE          |      N/A      |
    +-------------------------+-----------------------+---------------+
    |   Single CPE, multiple  | Internal hosts or CPE |      CPE      |
    |   provisioning domains  |                       |               |
    +-------------------------+-----------------------+---------------+
    | Multiple CPEs, multiple | Internal hosts or all |   CPEs (CPE1  |
    |   provisioning domains  |  CPEs (CPE1 and CPE2) |   and CPE2)   |
    +-------------------------+-----------------------+---------------+
    |  Multihomed enterprise, | Internal hosts or all |   CPEs (CPE1  |
    |   single provisioning   |  CPEs (CPE1 and CPE2) |   and CPE2)   |
    |          domain         |                       |               |
    +-------------------------+-----------------------+---------------+

                      Table 1: Sample Deployment Cases

   These deployment schemes are further discussed in the following
   subsections.

5.1.  Residential CPE

   Figure 5 depicts DOTS sessions that need to be established between a
   DOTS client (C) and two DOTS servers (S1, S2) within the context of
   the scenario described in Section 4.1.  As listed in Table 1, the
   DOTS client is hosted by the residential CPE.

                                            +--+
                                  ----------|S1|
                                /           +--+
                               /    DOTS Server Domain #1
                              /
                        +---+/
                        | C |
                        +---+\
                         CPE  \
                               \
                                \           +--+
                                  ----------|S2|
                                            +--+
                                    DOTS Server Domain #2

        Figure 5: DOTS Associations for a Multihomed Residential CPE

   The DOTS client MUST resolve the DOTS server's name provided by each
   provisioning domain using the DNS servers either learned from the
   respective provisioning domain or associated with the interface(s)
   for which a DOTS server was explicitly configured (Section 4).
   IPv6-capable DOTS clients MUST use the source address selection
   algorithm defined in [RFC6724] to select the candidate source
   addresses to contact each of these DOTS servers.  DOTS sessions MUST
   be established and MUST be maintained with each of the DOTS servers
   because the mitigation scope of each of these servers is restricted.
   The DOTS client MUST use the security credentials (a certificate,
   typically) provided by a provisioning domain to authenticate itself
   to the DOTS server(s) provided by the same provisioning domain.  How
   such security credentials are provided to the DOTS client is out of
   the scope of this document.  The reader may refer to Section 7.1 of
   [RFC9132] for more details about DOTS authentication methods.

   When conveying a mitigation request to protect the attack target(s),
   the DOTS client MUST select an available DOTS server whose network
   has assigned the IP prefixes from which target addresses or prefixes
   are derived.  This implies that if no appropriate DOTS server is
   found, the DOTS client MUST NOT send the mitigation request to any
   other available DOTS server.

   For example, a mitigation request to protect target resources bound
   to a PA IP address or prefix cannot be satisfied by a provisioning
   domain other than the one that owns those addresses or prefixes.
   Consequently, if a CPE detects a DDoS attack that spreads over all
   its network attachments, it MUST contact all DOTS servers for
   mitigation purposes.

   The DOTS client MUST be able to associate a DOTS server with each
   provisioning domain it serves.  For example, if the DOTS client is
   provisioned with S1 using DHCP when attaching to a first network and
   with S2 using Protocol Configuration Option (PCO) [TS.24008] when
   attaching to a second network, the DOTS client must record the
   interface from which a DOTS server was provisioned.  A DOTS signaling
   session to a given DOTS server must be established using the
   interface from which the DOTS server was provisioned.  If a DOTS
   server is explicitly configured, DOTS signaling with that server must
   be established via the interfaces that are indicated in the explicit
   configuration or via any active interface if no interface is
   configured.

5.2.  Multihomed Enterprise: Single CPE, Multiple Upstream ISPs

   Figure 6 illustrates the DOTS sessions that can be established with a
   client-domain DOTS gateway (hosted within the CPE as per Table 1)
   that is enabled within the context of the scenario described in
   Section 4.2.  This deployment is characterized as follows:

   *  One or more DOTS clients are enabled in hosts located in the
      internal network.

   *  A client-domain DOTS gateway is enabled to aggregate and then
      relay the requests towards upstream DOTS servers.

                                               +--+
              ....................   ----------|S1|
              .    +---+         . /           +--+
              .    | C1|----+    ./     DOTS Server Domain #1
              .    +---+    |    .
              .             |   /.
              .+---+      +-+-+/ .
              .| C3|------| G |  .
              .+---+      +-+-+\ .
              .            CPE  \.
              .     +---+    |   .
              .     | C2|----+   .\
              .     +---+        . \          +--+
              '..................'  ----------|S2|
                                              +--+
               DOTS Client Domain     DOTS Server Domain #2

       Figure 6: Multiple DOTS Clients, Single DOTS Gateway, Multiple
                                DOTS Servers

   When PA addresses or prefixes are in use, the same considerations
   discussed in Section 5.1 need to be followed by the client-domain
   DOTS gateway to contact its DOTS server(s).  The client-domain DOTS
   gateways can be reachable from DOTS clients by using a unicast
   address or an anycast address (Section 3.2.4 of [RFC8811]).

   Nevertheless, when PI addresses or prefixes are assigned, and absent
   any policy, the client-domain DOTS gateway SHOULD send mitigation
   requests to all its DOTS servers.  Otherwise, the attack traffic may
   still be delivered via the ISP that hasn't received the mitigation
   request.

   An alternate deployment model is depicted in Figure 7.  This
   deployment assumes that:

   *  One or more DOTS clients are enabled in hosts located in the
      internal network.  These DOTS clients may use [RFC8973] to
      discover their DOTS server(s).

   *  These DOTS clients communicate directly with upstream DOTS
      servers.

                                ..........
                                .  +--+  .
                          +--------|C1|--------+
                          |     .  +--+  .     |
                          |     .        .     |
                         +--+   .  +--+  .   +--+
                         |S2|------|C3|------|S1|
                         +--+   .  +--+  .   +--+
                          |     .        .     |
                          |     .  +--+  .     |
                          +--------|C2|--------+
                                .  +--+  .
                                '........'
                               DOTS Client
                                 Domain

           Figure 7: Multiple DOTS Clients, Multiple DOTS Servers

   If PI addresses or prefixes are in use, the DOTS client MUST send a
   mitigation request to all the DOTS servers.  The use of the same
   anycast addresses to reach these DOTS servers is NOT RECOMMENDED.  If
   a well-known anycast address is used to reach multiple DOTS servers,
   the CPE may not be able to select the appropriate provisioning domain
   to which the mitigation request should be forwarded.  As a
   consequence, the request may not be forwarded to the appropriate DOTS
   server.

   If PA addresses or prefixes are used, the same considerations
   discussed in Section 5.1 need to be followed by the DOTS clients.
   Because DOTS clients are not embedded in the CPE and multiple
   addresses or prefixes may not be assigned to the DOTS client
   (typically in an IPv4 context), some issues may arise in how to steer
   traffic towards the appropriate DOTS server by using the appropriate
   source IP address.  These complications discussed in [RFC4116] are
   not specific to DOTS.

   Another deployment approach is to enable many DOTS clients; each of
   them is responsible for handling communications with a specific DOTS
   server (see Figure 8).

                                ..........
                                .  +--+  .
                          +--------|C1|  .
                          |     .  +--+  .
                         +--+   .  +--+  .   +--+
                         |S2|   .  |C2|------|S1|
                         +--+   .  +--+  .   +--+
                                '........'
                               DOTS Client
                                 Domain

                    Figure 8: Single-Homed DOTS Clients

   For both deployments depicted in Figures 7 and 8, each DOTS client
   SHOULD be provided with policies (e.g., a prefix filter that is used
   to filter DDoS detection alarms) that will trigger DOTS
   communications with the DOTS servers.  Such policies will help the
   DOTS client to select the appropriate destination DOTS server.  The
   CPE MUST select the appropriate source IP address when forwarding
   DOTS messages received from an internal DOTS client.

5.3.  Multihomed Enterprise: Multiple CPEs, Multiple Upstream ISPs

   The deployments depicted in Figures 7 and 8 also apply to the
   scenario described in Section 4.3.  One specific problem for this
   scenario is to select the appropriate exit router when contacting a
   given DOTS server.

   An alternative deployment scheme is shown in Figure 9:

   *  DOTS clients are enabled in hosts located in the internal network.

   *  A client-domain DOTS gateway is enabled in each CPE (CPE1 and CPE2
      per Table 1).

   *  Each of these client-domain DOTS gateways communicates with the
      DOTS server of the provisioning domain.

                     .................................
                     .                 +---+         .
                     .    +------------| C1|----+    .
                     .    |            +---+    |    .
                     .    |                     |    .
              +--+   .  +-+-+      +---+      +-+-+  .   +--+
              |S2|------|G2 |------| C3|------|G1 |------|S1|
              +--+   .  +-+-+      +---+      +-+-+  .   +--+
                     .  CPE2                   CPE1  .
                     .    |            +---+    |    .
                     .    +------------| C2|----+    .
                     .                 +---+         .
                     '...............................'
                            DOTS Client Domain

     Figure 9: Multiple DOTS Clients, Multiple DOTS Gateways, Multiple
                                DOTS Servers

   When PI addresses or prefixes are used, DOTS clients MUST contact all
   the client-domain DOTS gateways to send a DOTS message.  Client-
   domain DOTS gateways will then relay the request to the DOTS servers
   as a function of local policy.  Note that (same) anycast addresses
   cannot be used to establish DOTS sessions between DOTS clients and
   client-domain DOTS gateways because only one DOTS gateway will
   receive the mitigation request.

   When PA addresses/prefixes are used, but no filter rules are provided
   to DOTS clients, the DOTS clients MUST contact all client-domain DOTS
   gateways simultaneously to send a DOTS message.  Client-domain DOTS
   gateways MUST check whether a received request is to be forwarded
   upstream (if the target IP prefix is managed by the upstream server)
   or rejected.

   When PA addresses or prefixes are used, but specific filter rules are
   provided to DOTS clients using some means that are out of scope of
   this document, the clients MUST select the appropriate client-domain
   DOTS gateway to reach.  The use of the same anycast addresses is NOT
   RECOMMENDED to reach client-domain DOTS gateways.

5.4.  Multihomed Enterprise: Single ISP

   The key difference between the scenario described in Section 4.4 and
   the other scenarios is that multihoming is provided by the same ISP.
   Concretely, that ISP can decide to provision the enterprise network
   with:

   *  The same DOTS server for all network attachments.

   *  Distinct DOTS servers for each network attachment.  These DOTS
      servers need to coordinate when a mitigation action is received
      from the enterprise network.

   In both cases, DOTS agents enabled within the enterprise network MAY
   decide to select one or all network attachments to send DOTS
   mitigation requests.

6.  Security Considerations

   A set of security threats related to multihoming is discussed in
   [RFC4218].

   DOTS-related security considerations are discussed in Section 5 of
   [RFC8811].

   DOTS clients should control the information that they share with peer
   DOTS servers.  In particular, if a DOTS client maintains DOTS
   sessions with specific DOTS servers per interconnection link, the
   DOTS client SHOULD NOT leak information specific to a given link to
   DOTS servers on different interconnection links that are not
   authorized to mitigate attacks for that given link.  Whether this
   constraint is relaxed is deployment specific and must be subject to
   explicit consent from the DOTS client domain administrator.  How to
   seek such consent is implementation and deployment specific.

7.  IANA Considerations

   This document has no IANA actions.
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